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(54) IMAGE ALIGNER AND IMAGE PROCESSOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To align, with high accuracy, 
three-dimensional transmitted images and two- 
dimensional transmitted images even if the posture of a 
subject varies at photographing. 
SOLUTION: An image reducing means 1 1 reduces 

inputted past three- dimensional image data Pp and tc 
two-dimensional present image data Pn to 1/10 image iiiM£Vrijf§ / 

data. An alignment image obtaining means 1 3 inputs past , - - - ^ 

three- dimensional reduced image data Pp' and present [ r 11 D « c Vd ! 

two-dimensional reduced image data Pn' from the image P, -J — >f fs^.jv f ^ > 
reducing means 1 1, and performs a transformation n nH — H jjjj | " > 

processing by a three-dimensional affine transformation i- 

with respect to the past three-dimensional reduced 
image data Pp'. Thereafter, a projection transformation 
is performed by a see-through projection, to obtain a 
past two-dimensional image data Pp" having a high 
correlation with the present two-dimensional reduced 
image data Pn'. 
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m&rM i ] m—&3*mz-?^z<D 2 -pcoiii«©ffi» 

buib 2 o<dbi$# 3 XTzmmwi&t 2 ^7immmmT& 
y. mzti.wst>^®t>\ mtE3'^mmmmti^m 

IB 2 ^TcfijiBiflt^ffiMtfX^ 2 %7E&|giBfft£ta8 
U S^*ti/c2^S^iii«^S?l32^3giSiii« 

•tfiS^-fet-r^toT^s c <h£ma<!:-r£B«!<*Mfi 

[fS5RH2] l^-«:fWCC>^T<D2 0©B<*<DtfciI 

buIBIhI— tt¥<*l::oi^TcD 2 ^©BAitf 3 &7CjSiBBfc 

3 %7cS»BKR^5«(lf3 2 ^7cSjflffii«tfflllll6 , 'ftf 2 
«7cU»KfM U Kf&fcSftfc 2 &7cttlgB«e 
buIB 2 ^Saffian* <fc 5 «»4>?ft « z. t * 

vfflST-fe -s c <t «m> t -r Strom 2 i BttoBtfcaas 

[000 1] 

O^TSSftte 2 OCDB«£>ffiK"&fc>-fc»: ; &ff 5 B«©ffi 
[0 0 0 2] 

©■•*ib«iwBLT, pfmtna)ttii«ir<. 

Slc*^T«¥<*<&«S»£?f5c<fcjb\ 

[0 0 0 3] ZOIWAWWJBaWlcas^Ttts 
35 «il!n a p Icoi,->T#tp d p OttSgO i: * tlfcBfc <h 

■JWJttnnsrsc tiz& y , mumi*e>mfiffii j t> 

[0 0 0 4] CtD£5lc N 2J-X±<DB«£ltgJ@&f2-r£ 



©HKctt* 2tX±OB« ; &B««^£M^? p, J>'£3IU: 
/&««»*©l*c:ti6<5!)iii«iai<0SST'**)b\ 

[0 0 0 5] fCT% it«BIIBfl!)»ftd:*ih.*2-3©H 

<DMs^«tii • am Ltcvy~\- =? f? -> 3 >wmzm zta 

S£LIMH*Jt-*-*C£#?S*4:**.5*i*. 
[0 0 0 6] C©B»M3W©l*fc» &B«4HC 

«feftfc«jft*<Bffi« (tt&j^ttttM&ii) £2oo>b 

S^*>tf©l»15<t LTlis 2 0<DB«!F,gT-¥*f 

EWE*fctttt* • «W*£ 1*3 

2 -3<©a«©-5-6— *<7)Bi«HC^»©'J^«!T**SI»l'& 

(x>7u-mw*) sscrs ffe7a© 

^3?4t>^ 3?466tlfc->7 h*lc»^T» ±IB^f*e<)% 

r^>^ (2*7un*#fl|*. n>2) (cj:«IMt^iE 
Xtt C7-tf>y) ^fflt^rc^p/rpil'&ffiS^te-Br^ff 
3x 2®|Ig<DffiS^t3-y:ft« (*BIT7-37074^45«^ 
JKS ! t#i i l : No.5,982,915) *41««6nTt>*. C<7)2S;l>g 
©itt«^to*»«(C«»:tU#s 2 0^H«^J±«fl«)S5flC 

[0 0 0 7] 

[R«tf|gStLJ:3&r«INH tC*T» M-O*^ 
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ISiIi«<75tf£'JMlH$. MMQ^MMR £fll^T±>d! 

[0 0 0 8] Ub*Ltt#6s »«HC£f*«l«:toB£fci* 
7*-;ta/ciIHgi£-ffl^T±ifi Lfc <fc 3 ^^RfrWSfiS^^ 

[0 0 0 9] ztxlcttU iE«*<^;i£<a«&% : &fi«l 

8E2001-44623, ^2001-129554) „ Z <D&ffi*$}mt 

tut. ®&mm*nm Ltzwm*m^z z tiz&v #g& 

[0 0 10] LfrL£#6. af^roMatf^i&LT^ 

SMBBUc^fc LTl^J??£aW+>-?- h =7 * -> a >0i«* 

0)<*tiSifi*i^o/c<!:^lcl*v 2ocD2^7Ejgj@iii«a) 
ttE^totfKtePgfiW&'X -r^TtD«iS*!!l^)±* ,; [WlP$ 

3 <t o icffi»^b-t±*?T 3 c: t it mmTS> q /to 
[001 1 ] -jjtt-crt. «^a^fp)±tcffL\ c 
tsi^mr i giWi3;i:*mmL?:3X7z<Dmmmm* 

'mZZttfvjmtt^T^Z, Z CD 3 ^TtiSjgffij 

[0 0 12] *l*e^±. ±IB*tflcffi^ JtiJBSlclTf: 

[0 0 1 3] 

[sa^)gj*-r^rc46cD#s] *^0^©iii«wffi»-&fc 
-e-gsau i^-«¥Wco^T<D2o<oiiHS<7Mfi»^fc 

icfc^r, 2 owh®*^ 3 ^mmmmt 2 xummm 



7Cjgisai«i*iiiii^iat^2:^jaiKiai«*^L, t^ja 
jnft 2 ttmimm* 2 ^s^iiHSi.!: 
« t ay T-fc £ c <h £ t$ *a <t f 3 t a) t- * * o 
[0014] c d T\ r 3 ttv&i&WSifr 6 2 :&7EigSJ 
a&^ffrrt^j <fci*> 3:^7EjSiiaiii«icja^ss^Bfi 
lt 2 -&7zmm&*'&% z t ^storr 
zntetewfoomut LTimtm&mzwm-rzz t 

[0 0 1 5] £/c, 3^7c2jaBi«!^6 2^7i;3SjSlitR 
.hfflBStfs;^ 2 :*7cJSS5iIi<i!£f1^!6-r LTli. 

«?itfs ®.mm\z%n.iT, 2^7us>a@i«i:ffl^i* ,i 

2 ^iaieilHSiAMf <=>ft% J: -5 tc 3 ^7c5g>iaSi«lc 
ttLT3&^tt&ft)t£8^<D£8l&il£SgU C©£ 

&&m&mzKtc 3 #TOSiSiiiisu:*t lt&i^sss-ss 

[0016] 3&7W§iaiIi«<!:LT^ CTgi^MR 

[0017] *^osi«sass»*, 

iiLW.-£t>iZ^mc<i:ViiLW-£t>itfttttirc2'z>(D 

arcwmwmgiWiz&^T. m—tmmz-o^T<n2~2 
(DM® & 3 ziTzmmmmt 2 ^TcjsjaaSiT-* v . mm 
£t>it^®t\ 3 %.7immwmfr e 2 jsisiii« t m 
Mtf&^2$tttSi&mi8i*ttmu ^7rn/c2^7cjs 

[0018] zzt\ pfuzommwmt lt»< «ju# 
-«¥^*^col^Ta)2^>coiii«^. b$^jwicr**bs 
[0019] *^oiii«ias^Btcfc^?,teS 

[0 0 2 0] 

tf» TO— «^#lcotNT<7) 3 :^7tjSjSiii«i: 2 ^tcJSjIS 
li«<tO<iB^-y'*. 3 &ro§>SiIH*fr 6 2 ^tcSJS 
Hflt <!: ffiHtftl' 2 %7cttKDMR«f^J«-r ^ C t lc J: ( J 

3 ;^^)S>SH«i: 2 ^ftmmmm<Dii.m^t>^n 
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[0021] -r&*>-5> mxi,£ 3 ^Ttmmmmiz 3 t!.7i 
Wsm&tmzm Lfc*ic»BB«*ff => z\z x. 

*i£ Z. t tg. < r^T<0«i6*ra±fl s d3 <£ 3 KffiS^fr 

[0 0 2 2] *«^©M*5aSS«lC«J:tl^ Rl— «¥ 
mco^T© 3 ^TcSjaiiflii: 2 ^7ca®DB«<t©'CiS 

3 %7GaaiBfltfr 5 2 %7GaaBB£BB# 

2 ^7cS»B«*fPfi)6-rs c £K <fc y iri\ ma* 
ttfc 2 ^7t»»iii«i: 2 %7c9»Htt^ *BITHME<D 

Baas**^*^ aaai;:«¥a«HMft*Btf*-3 
^tf** tifc 2 o©Ba*Jii^TWB<0Baaa*i53 

[0 0 2 3] FfjMVWtomm&y? t-^9*sa > 

aratrnwr. T^T<Daa*H±#$3j: 3 

[0 0 2 4] 

[«W©*«<we»] WT» *£B4)Ba<D1&Bdfce 

raaaaB?**. 

[0 0 2 5] **«flfcH©H«<BffiB^fe-e^iIl;:«B* 
s*ifdiB^b-y*«iou\ ra-a^afc-^T© 3 & 
mmntr— 9 p p 33*^2 *&&&Etm&—* p n 

*WSL *ft€»ft©1/1 0B'>SiB7 r -*£fftfcT 

«bbB'Ji*bii ffl««'j^«ni= J; vfemztut 

3 ZlTim&l&'bW&T-Z P p ' tS^Xf 2 %7Ea&B'J* 
i«f-5Pn' £A7JU 3 3fc7E»aB'.hBa7 r -r * 
Pp' tc»LT3*7E7»7-f >«»U:J:**«a»*» 

Lfc«, aaaaicj: saaaatfT^ 2 %7caaBB 

BAfta/aT***. 
[0 0 2 6] ffi«^t>-tt#«10lCA**tl*3*7ca* 

s«t-*pp8, c th^bic j: y mmzntc 3 #.tlv> 

ll9^aaBa*STHa7 r --S'T-3&».A 2&7GB&BB 
5 s -* Pn*y «bB*5!l«U:au k B«tz:aB*ftfc*i<B 

*r=. 2^>:7t^l^£is«7 : •— »PnuaB4>aa 
aaaaBtzj: y aastifc 2 %7E4>BaaaBB«a 

[0027] *ic» 4«aaa«>BaoffiBdt>i»iB 
WBitwar*. 

[0028] (tta&fe^aioiEssfcTcaasBax-* 



2O0I«f-^Pp, P n»B«B'J^®1HCA** 
*u *ti?ftl/l OBax-^KB'J^ti*. 
[0029] BBttsJ^Bl HC<t y ff «* tlfc 3 %tcB 

aflkhBBx— * p p ' & <fctf 2 ^m^'i^mm^— 
?pn' » % tta^fc-ttB«aa*ai3tcA**ti«. 
ttB^to«Baa»#«i37»tt, sramtcv 3%7ca 
asMw^Ba^-^pp' ic»LT3*7E7'7i'>aaic 
«fcsa»«a#»*n*. 

[0 0 3 0] 3 55C7c7'7^>*a«, iftx-^liJitL 

T3*7uW*a*«tt'K bb. Tffaaawaaaa 

*ar*>©T*»A 1 2<B^«»©fil : &£I!j3- 

ECTtt, *a&A*©«* 

«ft3*7ctt#(Matt (a««aa» aa» am k 
t>-gic£«£ftaa (wt, mm&te&mtrzo ) * 

3 ^TcBieB/jMBax-* P P ' ie» LT»T. 

[0031] saaaas#Bstifc3:ft7eaaa'ja! 
ir-fpp' aaaaic^^aaaaicafn 
5= &bb&£& s^Tcaax-^ics^Ts^Tt 
Ba«2^7c¥ffitta»-r«ci:ic<i:y. 3 ^sax 
-sr^sfcTcBa^-^icaa-r***®"?**. 

BaBB&& >fi<«>«6>fl>U:**<» B<«>«>4>li'JtS 
<*5L 2«OTfaitt 1 iaiCiRft^LTJlAStl^ 
fc «fc 3 * AM<DB»fcifil"»ttB*ao feS»aT»*. 

aittaaaaic.fe-saaaaoBa^-rBT**. 

B2tc^r«J:3lc, 3^7c»*tt'hBaP p' (KT1B 

(cncaaci9UTMar«. ) *aa*n>o^6 2* 
Tcvatcaatsaer * c <t k j; y , 3 %7cB£Bd«a 
Pp' ©2*7aftBBBP i #»s*i*. c©a» 2:* 
TtSiJiiiaP i fc&ltS&BBOBBBli* 3 3fc5ta* 

fiS'j^iaapp' ©aff**iQ (taa*ift) ©bbb«b 

[0 0 3 2] C©«fc3fc#;£tt:J:yx ffiBasb^BBB 

a^aisTttaaaaaatfa* ftfc 3 ^TtastS'J^ia 
tx-^ p p ' ica-^tT 2 %7ebbbb7— s« p 1* 
1 2a<oa«oa*a»*-e:*fl { 6 3*7c 
fflaSB'hSBax-^pp' tc»LT3*7u7'7-f vaa 
ic<fc5S»5as^iii^«s-r c <tte =fe y »s*ifc«sa» 
3 ^Tuaaa/jxBBx-* p p ' zm.^iuzm? 

^T2^7cSSJiii«7 :; -^P2~PN^#. ?#Stl/cS2 
*7C»Bi*f-$Pi (j=i~N) 2:^7L^ff 
ftiatf-*Pn' tOfflBafcS-tifftBtflU 2 

^Tcaaa/j^BBx-* p n • tmtm&ftM^ 2 
a/mm?—. 9 p i * 2 ^Tua^aax— s« pp" <h l 
Taar«. 

[0 0 3 3] *H)56»)8©iii««)f3ia^fcti:^»lcJ:tx 
«\ 3^TcJSX*S'J^iij«x-^ P p' K*fLT12<!<D 

fl»*a»j*fttf 677-r »as*u *a*et 
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c\ sjssj^jfttcd; y ttsn&aieBtt 

P i *n-F*l£ 2:*^iJ!?i*8'JMlHS!7 r -'$» P n' 
<h£j£»LT. 2&7E3R£tt'JMB«7 J -*Pn' £St> 
SHtfWl^tMBlHM 5 -* P i ^ 2 ^TuiS^Bi^^— ? 
Pp" t LTStfrr**^ »»B5fc«^*©tMfc£Ib 

[0 0 3 4] ±i3*fi»B«U:asi/ k Tt** ffiS^fc 
*B«*lMfr *l*teffiflHl8'J*#«i uc j: y fthartifc 
2oci«T-^pp' , Pn' &m^T— mornm* 

[0035] *fc, ±rettn$fe-emMK»#«i3ica5 

ft * £ y » C ©«*#W«« tc J: o T 2 3fc7cJ8S5 
B«P i *ffJSr«n$M&LT«iJ:t^ Tttt>5* CT 

©BiRfiS (CTfiS) ©*£» (SfcttTO) *«5T*« 
S»B«*fMW-* OUND © 

A6s ±IS©£ a lc, flX.tf|ft*tf# (»«) ©>iiB*£ 
* * * C £ tc <fc y aUEM lE^UD Tt!HBB«*fB8f « 

[0 0 3 6] il£<Di»IM8l£&(C£y 3*7CC tb*© 
(V1+V2+-+ vn) /N 

icfcy, n-UBM^itg (tB»flW)2*7ciH«icfif rra 
— ©x. ymm ttzzm <Dwmm (cut) ©t^* 

£oT2*7cSieBflK;:fcW-**W (x, y) ©BSHI 

[0 0 3 7] -75, a9M4(t!SfflicJ:y2%7ciSUeiB« 
P i fcfMWSBHutts srM I P&lcfcy 3;*7cCT 
B«©IH— ttHWKdfciiW-***© C T«*«l/>T 2 * 

«M USaW»#*«tHT « C <t ic «* y B«i* KfgjlJS 

T«nTt"««i#w#©aiai*f75. £©P8. m i p^ 

T2 *7nBMfc*f^J«-i-*BH!:fflt^fc»*C T«©*fT* 

ff*tt«*IM$er*c:<!:#7*S*. &*>\ &8I2000-2 
98100^tC|BK©^^«»t«fcy : ?«>)»ll5««=&lg«Lx 



[0 0 3 8] 3fclC, ftMM«fi£LTl^*JMT*tt«* j 
<t LT% M*Wt«»»cj:*2*7cl9«W»©***»J: 
*Stf*B*ffl*5feie» 

(aivi+a2V2H I- a j v j +•••+ ctn vf|) / (ai 

+ a2+ — +aN) 

tcj:y#*„ ffiU ai~aN»SiS*T»ys XJttiUE 
©SJg(CJ^i;Taj©ffl©^^^i!j#-ti-5. <5iJxl*'6fj# 

a j*«,fcy'h*<r*itfJ:t\, £3b\ 
ftb#©**t*Pg-^^©T\ ±IB*fr*fflB j liBfft+t 
<f X <h ©HffTBfttt lt£*.T «fc L\ 
[0 0 3 9] d©#;ilcd;tv«\ B*j#95#©jSjfi*©* 

c&(c£V, ««HiiB»tra*©»wt* 
&<Dmmt*mr * 2 ^tc»»b«*»* c <t # ?* 5 

©T\ 2^^a*g/jNB«x--> Pn' tJcyffiMtfffl 
f2 3555ai*B«5 s -*Pp" % 
fc\ C©#^lc«fc y»ffl*+i* 3 &7eMM*C TMMc 
RBS^nSfc©^**^ $fc, ±IB©Hfi6mfilT1*tt 

tt»»«ai**»b**fttf. a«cHi»att©*#© 

[0040] 2 ^TcSifiEBflRx- ?Pni:3 

iiSB*^-* P p©»«tt*-9--rX»fl«*fcS»^E 

[004 1] *5|B^©B«SaSSI»©^<*W&ll 
WOJBttSBintCBrJt^TlttW* - *. ■ 3 (i*«fJl©B 

[0042] **«fimtt©B«jiassa(is 

icot^T© 3 ^7cia*B«T f - ^ P pfccfcO- 2 ^Tcllli 
BfiRx—S? P n £A71 L> 2 ^Ttl^ffiBffliT 1 '-^ P n © 

1/10 iRg'j^B^T 1 - ( 2 ttm&fc'mto?- * ) 

Pn' K2^7iciI?S*S'>B#T r — ?P n' 

to-a-jti 5 ** nfc 2 ^Tcia^B^T 1 - ?pp" <t 

ffiH'JxB«^-£ P n ' t2 ^TciSSBiR^— ? P p " 
*A*U 21©2 0CDB#7 r -'S'^ffl^T+*-^>5f -> 

a >um&fjW7 b^<7~>B >m» p s *u«»r *-y- 
[0 0 4 3] ;^ic. *SISfifBjg©B«ifta^!l©fPffl* 
[0 0 4 4] ^yh^^«>3V««#«20tt» ffiM^to 

i^i/J^B«7 ^ — ?pn' <h2^7cja^B«!7 :; -'S'P p" * 

A*U fiIif-?Pn' , Pp" ©BSE^»fS*-& 
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TH»H3l**ff l\ *7 h 5?-> a VBMIt*-* P s 

P s = a 1 • P n ' — a 2 • P p " (fc/c U a 1 , 
a 2 

»<0TOM3Wlc<fcy»*E£#T*S. */fc> TIEiC 
T-a*n^J;-plc, mifM?SJI«>&lMV*Mr*IIKi 

*nflige) -*« (i 

Obit<DBH«(0<t*tt. fpmi&m i d = 5 1 2) «»0» 
[0 0 4 5] 

Ps= (a 1 • P n' — a 2 • P p" ) xcont+mid 
tctcU contttaVh^XhflMRs midtt«f>Mfil**-n 

[0 0 4 6] *HSfimigH:j:«H««iSS|JHcd:titf. 
tt«^t>-&#«iotcfeiNTr'<To«i*ftra±fl { $5<t 

3 ftSftfc 2 ^^Hffi«l'J^«^-^ P 

n' <t2^7UjS^iii^7 :r -'S'Pp" fcffll^T*?!*?? 
->aV«WS*ff3fl!)Ts ^^■:7>5*->^>BH»*^©7 , - 
?7 7<7\~ *M'J>m. 2 O0!>BH*M4>£JI«JlJg < f 

[0 0 4 7] ttat^to-&#«;10*, ±EPMtai& 

tt*8fmcj:y 2^7£i6Kis«p i WEmtzmmt lt 

l> 2 i<OWHtem l^TV- Zf h -5 * s s a V«k3£*7 OZ.L 
h * * 6 ic Jt^*«* C i: 

[0 0 4 8] ±IBIIfi6JK8llc«J:«ffii«5aa^Stc 
fe^Tit tt«£fe-t*^«ioic J; y fwwr n/c 2 ^tc» 
si«f-$ pp" t2 ^Ttm^m^mm^-^ p n ' 

€t«D« $ffl(.^Tt7 1«7* 5/3 P s *t 

fiELTl^6\ ffi«^b-e-#®10K J: y ff«* ftfc 2 * 

Ttmnm&r-* pp" 1 2 -&7tmizmm&T- * p 



73 LTB**S*J»*« fcH«M»»*ff C\ <T?> 5 "7 

[0 0 4 9] ±IB**«fB«u:33W , *ttB£fe-ii 
^ISIOICJ; y fFP2?n/c 2 ^TuB^En*^-* Pp" ^ 
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